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NEURAL NETWORKS 

Hyperbolic tanyent functions as neuronal s iynals 

Solve the JolJooJiny . -five problems . \ 

Pro hie m . 1 


Consider a neuronal siynal of the J orm oj a. hyperbolic 
tanyent Junction h(oix) - tanh (c<x) ^ cohere oc is a. 
positive parameter. Ferijy that 

1 r\ • 


(a) h (*x) - 


l + e 


-2UX. 


(lo) [h(*x)J = cx [i__ h 2 (**:j] 

Jx 


(c) r . AL [h C*x) ] 

doc. 


max 


-=: <=< ? occurring at x — O 


id) A—-[h(o(x)] - - 2 oc hC°Oc) [l - h (~< x)] 

d x 

Problem ~ 2 _ _ — 

A neuron receives .two inputs x ? = 2.3 and x 2 - t.E 
uJjth inputs ur f ..= 1 and 'ur 2 — 2 ^ respectively. The bias 
ujeiyht VS 0 is a desiyn parameter. The. .neuron employs 
a hyperbolic tanyent Junction oj. the Jorrn S - tanh (o,2 y)^ 
inhere s is the output siynal and y is the activation . 

(a) For .. ux o .- — 2.S r Jin d S . 

(b) For <S = 0 , 71 v Jind ZiT ... 


Problem 3 . . .. 

A sinyle neuron receives two inputs x 1 - l.E and 


2 


with weights^ ur r ^ X~ and- ^ respectively 

lie Lias weight is u; = O.if ... 7Te neuron employs w 
hyperbolic tanyent junction of the form S = tanh (0‘75g) s 
where S is-the output signal and y ts the activation* 

(a) Find the value of S . - 

(b) Find the. value of the derivative ~fj- • 

Cc) Plot s. as a junction of y and locale the operating 

point ( y , s) . 

(d) Plot -fj- as a junction of y and locate the operating 

point Cjo -jp) • ■ - 

(e) What - /s'... the maximum Value oj 

■ / 9 

it occur . 


d s 0 Where does 


■>uts 


Problem 4 . 

A single neuron - receives th 
and oc 3 =z 2.5 uiith weight , „ ^ 

V/-a -= - 1 respectively ... weight U~ 0 


ree mpi 
s -ur, - 1.2 , 


*1 = 2 , *2 


IS 


= 3, 
and 

ol design 


U v/ o 

parameter. Fie neuron employs a hyperbolic tangent 
juncb ion oj the form S — tank Co.Sg) ? uihere s is the 
output signal and y is the activation - Find the value of 
icr such that -fid- = 0.22 6. What are the corresponding 
values oj y and S j ... 

Pro b l&m , _ 6~. 

A single neuron receives two inputs x f - 0.8 and x 3 - 1.2 
with weights ur ..= 1.6 .and w 2 =O.G :> respectively. The bias 
weight is..ur o ~=:-l.U- 7Te neuron employs <x hyperbolic 
tangent junction oj the jorm S =. tanh (<2g) , where s is 
the output signal, y is the activation } and ©c is a positive, 
parameter . The derivative of s with respect to g is jound 
to be 0.311. Calculate the values oj oc >y , and S. 
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Consider a. n eu roaal signal of I A e -form, of a. 

r J yperMlc- tuy en t-juact/oa—hX*^. y^-tankj^L ) r M here 

1 ^ JX - a ~f° s itive~ p aramet&r- — Verify that 

' — ta ) — A (<*x ) - ^ ^ 


t +<T^ 


^^c 7 x" ^ — ** [ l - -~ h C°(X-) J. 


(O . o/ 

d>x 


[Jitex^X] S3 — °< v occurring , oc — O 


- -(a ! l ^ (“'■*)] = - 2 ecLkfcx) [l A % *0 ] 

alx J 

— So lution 

-- -i'a) -L^-HsS — s—iQnhjCpe.x)...- - sinkfcac) _. (<? _ e *** J/ 2. 
‘" A <**•> Ae*A.-tJ—J/_z 


„ -2<XXL 

- l - e 

" -2« 
i f C* 

= 


2-i -e 


-'Kx. 


1 + <? 


-2V< 


lf<? 


-2<X 


-d- m .[tanA .(*[_ 

=•.<* seeb CVx ) — [l - tanh* (<xx)J 

< 4 x 1 

~- <=< £x~ — h~C«x) ] . -. . 


Ccji SJa — obtain f/>e — maxima** - .value a-jf f Ae _ . Jirst 

— derivative, d [h Cx — u)e~--fir>cL__an expression 

£iae — scconS derivative g(.— [htVx)] a ncL^.-t equate _ it _ 

, „ olx'*' t 

to zero. 


nh fax)] a —4- . [sx^sech Qt-x.) 

Wx 2 tf/x 2 

^ ■2<*' sjsclnJL^x.) -tanh-(e<x;_) 

r-O _ ’ 

— <* — and sec h Wx) «/<? .— j reciter than z of/e_. 


Since. 


■kauljsJ — ha i/e 


tan h(°sfpc) — Q_ 


or 



(J.) — From — th € — sal-ul ion o £ part Cc ) 


--- i 


A r 2 2 

- j--j [tank ] 2oC sech C°<A:) iar} h fax) 

X = 2 o< — tank (M x). £_i — tan k-fax. )] 

~ — -2o t—h (*( x) fi h) 2 C°^X 




P^neuron -receives two inputs ..oc^ - 1.3 anal x 2 = X.S 
#ith inputs ur } - 1 and ~ ur 2 -2, respectively. The loiaS 
coeiy ht U£ is a desiyn parameter.. The neuron employs 
a. hyperbolic tanyent Junction oj the Jorm S = tanh (o.8y), 
cohere S is -the . output _ signal . anol y is the activation . 

(a) For ur - - 2. S j Jind s . 

(h) For S = 0,71 , Jind uT c . 

4-1 

Solution . - . - - - ■ - 1-3 

Activation ? ....... ^ -■ **£ 

y = (i.3)Ci) + ( l-S)(2 t ) + ur a - - , 

- 4 ‘3 -t K - TnT ) 

Srtanh(p.8y) 

(a) For us o = - 2 ,S , - - 

m = if. 3 - 2. S = 1.8- \ l.S 

S - tanh (a 8x1.8) 

- o. 83^ - 


; - tanh ( p - Sy ) 


(lo) For S = o, 71 , 

tanh (o.&y) — 0.3 1 ^ 

0.8 y - tanh ( o .^ l ) 

u. =. 1.103 

> ■ ... . 4. 3 ... -f- = 1* 1^3 - ■ 

yr - -3.131 


= 0.881 



4 _ jingle - n ear on — receives two in puts x^ = i,S ancL 

Xj]l _x^~Z — with — U) eight* — MT y n 2 and ^-^iA^res pectivelgg 

The bias weight — is — i<£_=^0..4— The neuron employs a 

h gftrJjoJjc— tangent- — function oj the —Jorm S — tanh ip. 7Sg) r ~ 

where — £—iS — the — output signal and— g— is the — a c tiv a tio n — 

(a) find. the value oj ' 

Jib)— Find- -fh e — value a£ the derivative— 

ic) Bi a t — S — a s a Jan c t ion- _ oj—g and — lac a te- the— operate rig 


point-(y^) 


» I w 

(d) -Blot fjff . a s aj u notion oj g- and — / oca te — th e~ -opera tj ng 

p oin , ~~T~~) — — 

(e) -What is the ---maximum value ot — ?/ .£. P lA/h ere- — does — 

o J da * 


Solution f 1 — 

~~ i — . _ . i - , i. 

-Ac tiva tion , -0-£ 

Output signal, 

S ^Jtan h-(Q*J? SX-1^2 ) — rr — O+Jtl 6 

-be rivativej 

ds - o- JS sech --(o.-JSJj) - 0‘ 7S [ 1 — tanh -(o.i?Spj)J 

Cl ~ s 3 ) 


S x tanh (o. 15$) 
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A single . neuron- recedes — three- -inputs- x r ~ 2 , 

^jc^ “ 3 7 — and — *^*3 =r- 2+S — u)i th — U)£tphts — it/^ — s= 1* 2 ^ — s — 1+1 , 

_ and — ur^_ - respectively +. -The. -hiasL welyht- ur o __ v'x ^ 

_ esiyn p a ram eter.- Th e n euronem ploys— a— hyp erbolic — 

kanyenL— function. -ej- the—jorm S-a-tanh-Co»Sy ) , .mb e re 

S—JS- the—, output sly no L and— y— .is.— the — activation • J^nocL 

the— value. -ol - **£ such that djL -0-226 * lA/hat — are 

J /. / / 9 

_ the^ -corresporiolmoj— values -oj- y —and— S— {- 

. Sola lion _ 2 . — — 

— y --(2)0^2)+-(3)(~ni) 

_ ^Xz,S)(- lL + 2 aT 0 3 Jf/sT) -+S - 

= ^ Tfan A 0 7 sj 7 

betiva tive^f — '. 

AL. = .°-S-Atdi (e-SjJ a.y- 

_•! ~ £ 7 . 5 [~1 — tank * (a- Sy jj. ' — 

r-^)-2 2 C — 

tcmh* (<?±5y )—=: _ 0< SJ+& _____ — 

t ol nh -(o <S y 1 — ——^OxSMr- f? ~ — i. — O.JJ+ — — 

ShSJj —±0‘3S 


S = fan A 


.~±a <3 

±1.3 




»_ 2 . 9 ; — - U3-+ 3 ■ b-=- s. 3 y — s -=- kanb (o. S X 1.9 ) = 0 . Itf. 

. - - ^ M , I / 


J ~ ' " * V ' / 

for + 3+k-s:- t • — S^r banh (-o,S* t .9) =r 


<0*1 If- 


h single n e urc n receives t»o !nputs =0 . s , and 

X J~ = f' a ™*^- Me & ts -^^-^C^»cL-PS-*a.C r re£pec t-ivel. 
i - tUS ujej<j t jS pj- _. — The- neuron— employs ~al 

^!jf >er ^ a l ,c ^ Qn jent^^MPctjor)^_ 0 ^_ — th e— -form Ss tank%^, 

inhere.- s . is _ the output... signal ? _ .y _j s the activation 7 a 
ex. __i j _ a posi live parameter , — The— derivative- cp- s with 

respect - to ~Lj _ ,’s - JounoL _ to. he . 0.311 Calculate the,- _ 

values- oj- oc ? -g- and S. 

. o _+X 

Solution _ \ r - . 

~ 

- Activation , v 

3’ - (°'8)Ci'6)-+ (i. 2 )(o.t) -1,1+ * 6 

-beriiTtive, J>^S ; t o nkin) ~ 

_‘i£_ - oCsech 1-Z 

— —H- — - -of £l — tank— O^g)] - 

- =-0.-31 1 ^ 

tanh-(P'£> °< )~1 °' 3 * ^ 


-J.V 


w— * 


cxl 


fcanh* [o. Co < ) 



2 

3 

4 

0.69r 

^•836 

o.$68 

0.81+ S’ 

o- 866 

0.922 



Janetta 


. from the cjytz.ph y 

_c< — — 3 

O'a tput signal , 

S—x tanh (o, & x 3 ) 

=— o ■ 


— o.$ — 

a.C 

o-A 

0.2 

0 -\— 











